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How do our brains respond when we are being watched by a group of people? Despite 
the large volume of literature devoted to face processing, this question has received 
very little attention. Here we measured the effects on the face-sensitive N170 and 
other ERPs to viewing displays of one, two and three faces in two experiments. In 
Experiment 1, overall image brightness and contrast were adjusted to be constant, 
whereas in Experiment 2 local contrast and brightness of individual faces were not 
manipulated. A robust positive-negative-positive (P100-N170-P250) ERP complex and an 
additional late positive ERP the P400, were elicited to all stimulus types. As the number 
of faces in the display increased, N170 amplitude increased for both stimulus sets, 
and latency increased in Experiment 2. P100 latency and P250 amplitude were affected 
by changes in overall brightness and contrast, but not by the number of faces in the 
display per se. In Experiment 1 when overall brightness and contrast were adjusted to 
be constant, later ERP (P250 and P400) latencies showed differences as a function of 
hemisphere. Hence, our data indicate that N170 increases its magnitude when multiple 
faces are seen, apparently impervious to basic low-level stimulus features including 
stimulus size. Outstanding questions remain regarding category-sensitive neural activity 
that is elicited to viewing multiple items of stimulus categories other than faces. 
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INTRODUCTION 

Why do we feel self-conscious when we are being watched by a 
group of people? If we are required to perform a certain task, 
then the fact that we know that we are being watched by oth- 
ers can potentially alter our behavior (Conty et al., 2010a,b). It 
is the scrutiny of others and their gaze falling on us that is said 
to be at the heart of the problem. Perceived direct gaze from oth- 
ers is thought to increase arousal in the individual being watched 
(Conty et al., 2010a,b). Interestingly, this effect can be seen even 
when isolated eyes, devoid of the rest of the face, are presented 
(Conty et al, 2010b). What happens at the neural level when we 
feel we are being watched by more than one person? Despite this 
situation occurring on a daily basis, it has nevertheless received 
little scrutiny, despite the extremely large literature on the neural 
correlates of various types of anxiety. Social anxiety has typically 
been investigated in terms of the brain's response to viewing a 
face with an emotional expression such as fear or anger, with 
personality type influencing how the brain responds to the facial 
expression (Cremers et al, 2010; Demenescu et al., 2010; Calder 
et al, 2011). 

There is now a very large neuroimaging literature examining 
neural responses to static faces and objects, which has identified 
a number of active loci in ventral and lateral occipitotemporal 



cortex centered on the fusiform gyrus, inferior occipital gyrus 
and superior temporal sulcus in functional magnetic resonance 
imaging (fMRI) studies (Haxby et al., 2000; Tsao and Livingstone, 
2008; Towler and Eimer, 2012). Neurophysiologically, images of 
static faces and objects elicit a series of event-related potential 
(ERP) components, one of which is the N170 in electroen- 
cephalography (EEC) or the M170 in magnetoencephalography 
(MEG). The majority of studies have reported that N170 tends 
to be larger to face stimuli relative to other stimulus categories 
including objects, and tends to have larger amplitude and greater 
spatial extent in the right occipitotemporal scalp (Bentin et al, 
1996; Towler and Eimer, 2012). These findings have prompted 
the idea that N/M170 is sensitive to the categorical nature of the 
stimulus, and there is an interesting debate in the literature as to 
its functional significance e.g., (Rossion et al., 2003; Meeren et al., 
2008) that is beyond the scope of the current manuscript. P100, 
an ERP component that precedes N170, also can exhibit larger 
amplitudes to faces relative to other stimulus categories in chil- 
dren and adults alike, which are proposed to be driven more by 
low-level visual cues in the stimulus (Taylor et al, 2004; Kuefner 
et al., 2010; Rossion and Caharel, 201 1). 

With respect to the N170 elicited to the face, it has been pro- 
posed that it is the eyes that drive most of the N170 response 
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when a face stimulus is viewed, and this has been based largely 
on the observation that eyes in isolation produce N170s that 
are significantly larger and later than those seen to the full 
face (Itier et al, 2006; Itier and Batty, 2009). Multiple studies 
have shown robust ERP activity to viewing a single face avert- 
ing its gaze or gazing directly at the viewer (Puce et al, 2000, 
2003; Conty et al, 2007; Itier et al, 2007; George and Conty, 
2008; Itier and Batty, 2009). The posterior temporal N170 or 
Ml 70 changes its amplitude as a function of gaze direction, 
which might be modulated by changes in social attention. In a 
linear array of three faces the initial stimulus in the trial con- 
sists of a central face with direct gaze (at the viewer) and two 
flankers with averted gaze in the same direction. Then after a 
period of time the central face averts its gaze and the flanker 
faces do not change their (already) deviated gaze. N170 ERPs 
are elicited to the gaze change by the central face in all stimu- 
lus conditions (where social context has been varied as a function 
of direction of averted gaze in the central face). Interestingly, 
N170 amplitudes and latencies are unaffected by the social con- 
text of the gaze aversion, unlike subsequent ERP components at 
around 350-500 ms which differentiated according to social con- 
text (Carrick et al, 2007). However, the number of faces being 
viewed in each trial was always kept constant — a very unrealis- 
tic situation to what is encountered on a daily basis, where we 
interact with individuals as they come and go in groups or in 
isolation. 

A potential problem that is created in varying the number of 
faces or individuals in the display lies in the changes that can be 
induced in the overall luminance, contrast and spatial frequency 
of the image. Similarly, changes in the visual scene or its con- 
tent, such as material taken from cinematic movies, where visual 
stimulation is effectively uncontrolled have these same potential 
drawbacks. Yet, in order to really begin to understand the neu- 
ral bases of interactions with our environment and with other 
individuals, it is necessary to use dynamic visual displays that 
vary their content and context. Remarkably, in fMRI studies sim- 
ilar activation patterns have been documented in populations of 
subjects to these uncontrolled visual stimuli relative to other pre- 
vious (controlled) studies in the field e.g., (Bartels and Zeki, 2004; 
Hasson et al, 2004, 2010). In some cases, activation in additional 
brain regions was also demonstrated (Hasson et al., 2010). Studies 
of naturalistic visual stimulation of EEG/MEG are not numerous, 
but focal EEG changes (as determined by neural source model- 
ing) have been demonstrated on millisecond time-scale relative 
to slower time-courses in fMRI using visual stimulation that con- 
sists of a cinematic movie (Whittingstall et al., 2010). Indeed, 
invasive EEG recordings in humans demonstrate that naturalistic 
(audio) visual stimulation elicits category-selective neural activ- 
ity, which appears to be more selective than that reported for 
fMRI (Privman et al, 2007; Meshulam et al, 2013), and more 
temporally extensive relative to the presentation of static stimuli 
(Senkowski et al, 2007). 

One way to explicitly study the effects of multiple stimu- 
lus items have on neural activity is by numerosity judgment. 
Numerosity can be judged on either a temporal or spatial scale. 
Spatial numerosity judgments can be made to multiple stimuli 
in homogeneous arrays (as in the current study), or in mixed 



arrays with multiple targets and distractors (Pagano and Mazza, 

2012) . For these mixed arrays of targets and distractors, the main 
ERP of interest has been the N2pc — a parietal scalp potential 
that is sensitive to the spatial position (lateralized of the target 
stimulus — which is modulated monotonically by target num- 
ber for explicit judgments of numerosity (Pagano and Mazza, 
2012; Mazza et al., 2013) or for judgments involving subitizing 
(Ester et al., 2012). The behavior of N2pc and Nl have been 
dissociated in ERP studies, where Nl has been found to be mod- 
ulated by increasing item number when targets are presented 
without distracters, whereas N2pc will exhibit modulation as a 
function of numerosity in all types of displays (Mazza et al., 

2013) . Interestingly, the number of items to be processed will also 
produce temporally and spatially dissociable neural activity that 
distinguishes explicit counting from subitizing (Vuokko et al., 
2013), although variables such as the visual cue size (when deal- 
ing with the spatial extent in dot displays) may greatly influence 
the ERP measures (Gebuis and Reynvoet, 2013). 

Here we studied how neural responses, specifically P100, N170 
(Nl), and P250, varied when individuals face the direct gaze 
of differing numbers of faces — a likely scenario that would be 
often encountered in naturalistic stimulation. While we predicted 
that augmented neural responses would be elicited when mul- 
tiple faces are viewed relative to a solitary face, however, we 
were uncertain if the increase in response magnitude would scale 
proportionally as a function of face number, or would be con- 
stant for numbers of faces greater than one. We performed two 
experiments to examine this question. In Experiment 1, overall 
brightness and contrast of the visual display were adjusted to be 
constant. In Experiment 2, we chose to use a display in which the 
overall luminance and contrast (with respect to the faces them- 
selves) were not constant, so as to elicit a situation that might 
occur during a more naturalistic viewing situation such as when 
viewing movie-based materials where visually stimulus character- 
istics such as brightness, contrast, and spatial frequency are not 
controlled. Subjects made a forced 3-choice button press to indi- 
cate how many faces were presented in the display in which no 
distracter items were present. 

MATERIALS AND METHODS 

Two experiments were performed, each on a different group of 
subjects. Below we describe the attributes of the participants, as 
well as data acquisition and analysis separately in each section. 

PARTICIPANTS 

All studied participants had normal or corrected-to-normal 
vision. No participant reported a previous history of psychi- 
atric or neurological illness. Both experiments were approved by 
the West Virginia University Institutional Review Board for the 
Protection of Human Research Subjects. 

Experiment 1 

Fourteen healthy volunteers participated in this study. Due to 
technical difficulties, data from one of the 14 participants were 
excluded. Hence, for the 13 participants included in the data anal- 
yses mean age was 22.1 ± 3.4 years, and there were eight females. 
Eleven participants were right-handed and two were left-handed. 
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Experiment 2 

A total of 18 right-handed healthy volunteers were studied. Data 
from four participants in this group were excluded due to exces- 
sive artifacts such as blinking and EMG activity. Hence, for the 
final group of 14 participants mean age was 21.6 ± 3.3 years, and 
there were eight males and six females. 

VISUAL STIMULATION 

For both experiments, participants were seated in a comfortable 
reclining chair in a quiet, dimly lit room. Each participant fixated 
on the center of a visual display where grayscale images of one, 
two, or three smiling faces were presented. Overall, the total num- 
ber of male and female faces appearing in each stimulus condition 
were equated, as were the repeats of each face image. Stimuli 
were generated from a base set of 30 female and 30 male faces 
which had been photographed with identical lighting and angle. 
All faces gazed directly at the observer and displayed a happy 
expression. In Experiment 1, stimuli were adjusted to ensure that 
overall brightness and contrast of the visual display was constant. 
The adjustments were made based on measurements of grayscale 
luminance and contrast values in each image using Photoshop. 
The contrast value was effectively a root-mean-square calcula- 
tion (across the entire image) and the brightness measure was the 
mean luminance across the entire image (including background 
for the stimulus). This meant that the local brightness and con- 
trast of the individual faces in the image varied systematically due 
to the need to compensate overall brightness and contrast in the 
image. The rectangular image with the faces was presented on a 
gray computer screen. In Experiment 2, stimuli were presented 
without these adjustments, hence preserving the local bright- 
ness and contrast characteristics of the stimulus image across the 
experiment, despite having large variations in the overall bright- 
ness and contrast of the stimuli as a function of face number. The 
image itself was presented on a black computer screen. As the 
same stimulus faces were utilized in the two experiments, we stud- 
ied two separate groups of participants, so that any effects due to 
familiarity or repetition would not act as cross-session confounds. 

In both experiments, each stimulus remained on the screen 
for 1 s until replaced by a plain background screen for 1 s. 
(Experiment 1: 50% gray overall background with an irregular 
pattern inset; Experiment 2: white background). The three stim- 
ulus conditions (single face, two faces, three faces) were presented 
in pseudorandom order, with no consecutive images of a particu- 
lar stimulus type. There were a total of 60 exemplars for each trial 
type. Stimuli were presented in two to three separate viewing runs 
of 3-5 min each. Subjects were asked to respond to each stimulus 
and indicate the number of faces in the display by pressing one of 
three response buttons. 

Experiment 1 [preserved global brightness and contrast (GBC)J 

Participants sat positioned approximately 195 cm from a white 
wall on which stimuli were presented on a gray background 
with a grayscale rectangle consisting of an irregular patterned 
background housing the face stimuli (see Figure 1A top panel) 
which subtended a total visual angle of 25.4 (horizontal) x 17.5 
(vertical) degrees, respectively. Average visual angles subtended 
by images of one, two, and three faces were 8.9 x 26.0, 12.4 x 



26.0, and 18.8 x 26.0 degrees, respectively. Overall mean con- 
trast (Figure IB, broken line) and brightness (Figure 1C) of the 
images were plotted as a function for each stimulus category and 
did not change as a function of increasing face number in the GBC 
stimulus set. 

Experiment 2 [preserved local brightness and contrast (LBC)] 

Participants sat positioned approximately 165 cm from a 33 cm 
computer monitor. Stimuli were presented on a black back- 
ground with a white rectangle housing the face stimuli (see 
Figure 1A bottom panel) that subtended a total visual angle of 

4.0 (horizontal) x 3.0 (vertical) degrees. Average visual angles 
subtended by images of one, two, and three faces were 0.7 x 1.3, 

2.1 x 1.3, and 3.3 x 1.3 degrees, respectively. Mean brightness 
and contrast were measured for each image using Photoshop 7.1 
(Adobe Systems Inc.) and the overall mean brightness and con- 
trast plotted as a function for each stimulus category. There was 
a near linear increase in overall contrast (Figure IB, solid line) 
and decrease in overall brightness (Figure ID) as a function of 
increasing face number in the LBC stimulus set. Having said that, 
the face stimuli remained unaltered with respect to their local 
luminance and contrast, unlike in the GBC where the brightness 
and contrast of the faces had to be altered to ensure a constant 
overall image brightness and contrast. 

EEG RECORDINGS 

For both experiments an identical recording procedure was used. 
Each participant was fitted with a 128 channels Neuroscan 
Electrocap with sintered Ag/AgCl electrodes. A dual reference 
electrode was placed on either side of the nose and a mid- 
line frontal ground electrode was located on the electrode cap. 
Electrodes were also placed to record horizontal electrooculogram 
(EOG) from the outer canthus of each eye and vertical EOG from 
above and below the left eye. All electrode impedances were below 
15 kQ. Continuous EEG and EOG were recorded from 128 chan- 
nels on a Neuroscan Synamps amplifier using a band pass filter of 
0.1-100 Hz and a gain of 5000 while each participant performed 
the task. Subjects were asked to keep movements to a minimum 
and, if possible, to restrict blinking to moments between stimulus 
presentations. 

EEG AND ERP DATA ANALYSIS 

For both experiments an identical data analysis procedure was 
utilized. The continuous EEG file was epoched, by segment- 
ing the EEG record into 1020 ms epochs starting with a 100 ms 
pre-stimulus baseline. Trials with artifacts in the data were iden- 
tified using a two-stage artifact detection procedure. First, an 
automated procedure identified and epochs rejected if activ- 
ity exceeded ±75 [iV, so as to reject epochs with eyeblinks and 
head/neck movements. Second, all remaining epochs were visu- 
ally inspected to eliminate any other epochs containing additional 
artifacts. All trials with artifacts were excluded from further 
analysis. 

The epoch baseline was adjusted by subtracting the mean 
amplitude of the pre-stimulus period from all data points within 
the epoch. EEG epochs were then averaged by stimulus type for 
each individual subject. Data were additionally digitally filtered 
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FIGURE 1 | Overall brightness and contrast (means and standard errors) 
for the two face stimulus sets. (A) Sample stimuli from Experiment 1 (GBC 
stimulus set, top panel) and Experiment 2 (LBC stimulus set, bottom panel) 
showing one, two, and three faces. Grayscale faces appeared on a scrambled 
grayscale (Experiment 1) or a white (Experiment 2) background. (B) Overall 
contrast as a function of face number for Experiment 1 (broken line) and 



Experiment 2 (solid line). Average contrast increased as a near linear function 
of increasing number of faces in the visual display for Experiment 2 and was 
constant for Experiment 1 . (C) Overall brightness was adjusted to remain 
constant regardless of the number of faces in the visual display for 
Experiment 1 . (D) Overall brightness decreased linearly as a function of face 
number in Experiment 2. 



using a 60 Hz band pass with a zero phase shift. Average ERP 
waveforms were generated for each subject and each condition for 
both experiments. Subject data were included in the final analysis 
if there were at least 45 trials per condition that could contribute 
to the average (of a total of 60 trials/condition). In Experiment 1 
no subjects were excluded for this reason, and in Experiment 2 
the data of 4 subjects were excluded due to this minimum trial 
number criterion. 

For each experiment, grand average ERP waveforms were cre- 
ated for each condition across each subject group. Grand average 
ERP waveforms were visually inspected at time points corre- 
sponding to ERP components. For both experiments, the data of 
each individual participant were screened to identify ERP com- 
ponent peak latencies and amplitudes using a semi-automated 
procedure. A latency window specific to the ERP component of 
interest was created and a peak-picking algorithm identified the 
corresponding ERP peak. For PI 00 we chose a latency interval 
of 68-140 ms, and for the subsequent ERPs latency interval of 
116-212 ms (N170), 170-290 ms (P250), and 312-650 ms (P400) 
were used. The peak amplitudes and latencies for each ERP com- 
ponent in an electrode cluster in each hemisphere (see below) 
were averaged and these data formed the input for the statistical 
analysis. 

For both experiments topographic voltage maps were created 
at time points corresponding to ERP peaks so that the scalp 
distributions of the ERP activity could be visualized. Clusters of 



electrodes showing maximum ERP component amplitudes were 
identified in the bilateral temporo-occipital scalp, consistent with 
electrode positions that showed maxima in our previous studies 
(Puce et al, 2000, 2003; Brefczynski-Lewis et al, 2011), which 
were chosen to form an even cluster around electrodes P8, P08, 
and P10, and their respective left hemisphere homologues. These 
10-10 electrode positions have been typically observed to pro- 
duce N170s of maximal amplitude in previous studies. All results 
described in the subsequent sections are derived from data using 
these electrode clusters. 

STATISTICAL ANALYSIS OF ERP DATA 

An identical statistical analysis was performed for each exper- 
iment. For each participant, ERP data were averaged among 
adjacent selected electrodes in areas where the greatest activ- 
ity was observed in the topographic maps. Average ERP peak 
latencies and amplitudes were calculated for each four-electrode 
cluster located on the temporo-occipital scalp in each hemisphere 
for each subject. These data formed the input for the statistical 
analysis. 

For each experiment, differences in ERP peak latency and 
amplitude as a function of condition were assessed by perform- 
ing a General Linear Model analysis with factors of Face Number 
(One, Two, Three) x Hemisphere (Left, Right). Statistically sig- 
nificant results were identified as p < 0.05 (Greenhouse-Geiser 
corrected), which were then followed up with contrasts using 
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SPSS V15 (Bonferroni corrected). Hemisphere here refers to the 
side of EEG recording. 

RESULTS 
BEHAVIOR 

In Experiment 1 subjects performed with a high-degree of accu- 
racy, with accuracy rates being 98.6, 98.9, and 98.5% for 1, 2, 
and 3 faces, respectively. Reaction times for 1, 2, and 3 faces, 
respectively were 538.5 ± 68.5 ms, 541.6 ± 65.2 ms), and 541.2 ± 
84.6 ms (mean ± standard deviation). Accuracy and response 
times did not differ as a function of condition, as shown by one- 
way ANOVA. Behavioral data from Experiment 2 were collected 
and analyzed, however, due to an issue with digital archiving 
could not be accessed. 

ERP DATA 

In both experiments a prominent positive-negative-positive ERP 
complex consisting of three ERP components (P100, N170, and 
P250) was elicited to all three viewing conditions (Figure 2) and 
was maximal at the bilateral temporo-occipital scalp in both 
experiments (Figure 3). Additionally, a subsequent later positive 
ERP component (P400) was also seen appeared to be larger to 
Experiment 1 relative to Experiment 2 (compare each set of wave- 
forms in Figures 2A,B). The amplitudes (Figure 2) and spatial 
extent (Figure 3) of the ERPs were typically larger in the right 



hemisphere. The ERP morphology observed here in two exper- 
iments was consistent with that elicited in our previous studies 
(Puce et al, 2000, 2003; Carrick et al., 2007). 

We performed identical statistical analyses on the data from 
each experiment to examine how elicited neural activity was mod- 
ulated by number of faces. We chose to perform separate analyses 
given the very large differences in ERP latencies and amplitudes 
(see above) that were elicited to quite different conditions of 
visual stimulation. Below, we report on the statistical analysis for 
the two experiments. 

EXPERIMENT 1: PRESERVED GLOBAL BRIGHTNESS AND 

CONTRAST (GBC) 

ERP latency differences 

For both PI 00 and N170 there were no main effects of con- 
dition or hemisphere, or interaction effects (see also Figure 4B 
for N170 data). Only the later ERPs showed latency differences 
between conditions. For P250 latency there was a main effect of 
hemisphere 13) = 8.70, P < 0.025], with significantly longer 
latencies being observed in the right hemisphere. Similarly, for 
P400 latency there was also a hemispheric main effect [F(i, 13) = 
24.19, P < 0.001]. However, in contrast to P250, the right hemi- 
sphere showed shorter latencies for P400. There were no sig- 
nificant interaction effects for the P100, N170, P250, or P400 
latency data. 




FIGURE 2 I Group average ERPs as a function of stimulus set and 
hemisphere. Data show clear P100, N170, P250, and P400 activity in the 
right (A,C) and left (B,D) hemispheres for all stimulus conditions. Different 
ERP waveforms increasing number of faces in the display in all plots from 
green to blue to red. (A,B) Data from Experiment 1 (GBC stimulus set). In 
addition to the earlier ERP components, a prominent P400 is visible in both 
hemispheres for all stimulus conditions. (CD) Data from Experiment 2 (LBC 
stimulus set). A clear P100, N170, and P250 is seen. The vertical broken lines 
between parts (A) and (C), and between (B) and (D) demonstrate a clear 



latency shift for all ERP components across the two stimulus sets in both 
hemispheres, with shorter latencies occurring for stimuli with greatest overall 
brightness and contrast. Legend: horizontal and vertical calibration bars in 
(C) apply to all parts of the figure. Small vertical solid line overlying the earlier 
part of the ERP waveforms indicates stimulus delivery relative to a 100 ms 
pre-stimulus baseline. The small topographic maps (taken from the three face 
condition in Figure 3) in the top right corners of (A,B) highlight a 
four-electrode cluster from which data were taken (enclosed by a small black 
circle) for display and also for statistical analyses. 
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FIGURE 3 | Topographic voltage maps displaying P100, N170, P250, and 
P400 ERP activity at their maximal time points. (A) GBC stimulus set 
(Experiment 1). Black dots on topographic maps show recording sensor 
locations. Vertical color calibration bars at the right of each set of maps show 



microvolt scale — a function of the size of the ERP component. (B) LBC 
stimulus set (Experiment 2). The distribution for components is similar across 
stimulus sets, but the spatial extent appears to be more focal for the data 
elicited to equated stimulus set (A). 



ERP amplitude differences 

PI 00 showed no significant main effects across number of faces 
or recording hemisphere, however, a significant interaction effect 
was observed [Fq 26) = 5.26, p < 0.05]. This interaction effect 
was produced by significantly larger PI 00s to the three face con- 
dition relative to one and two faces in the left hemisphere ( 1 vs. 3 
F = 5.60, p < 0.05; 2 vs. 3 F = 5.80, p < 0.05). 

N170 amplitude showed a significant main effect for face 
condition [Fp, 26) = 10.10, p < 0.0025; see also Figure 4A] and 
no main effect for hemisphere or interaction effect. Contrasts 
indicated N170 amplitude differences between viewing one vs. 
three faces [F(i_ 13) = 32.17, p < 0.0001], and two vs. three 
faces [F(i t 13) = 4.94, P < 0.05], and not for one vs. two faces 
[F ( i, 13) = 3.50, ns]. 

No significant main or interaction effects were observed for 
P250 or P400 amplitudes. 

EXPERIMENT 2: PRESERVED LOCAL BRIGHTNESS AND 

CONTRAST (LBC) 

ERP latency differences 

Using stimuli in which local luminance and contrast were not 
manipulated generated significant main effects of number of faces 
for both P100 [F (2 , 2 4) = 6.06, p < 0.01] and N170 [F (2 , 2 4) = 
13.77, p < 0.0001] latencies. The longest latencies were typi- 
cally observed for the single face display. PI 00 latency effects 
were driven by a difference between viewing one vs. three faces 
[F(i t 12) = 8.15, p < 0.025], and one vs. two faces [F(i, 12) = 
7.03, p < 0.025], but not for viewing two vs. three faces 



[_F(! 12 ) = 0.10, ns]. Similarly, for N170 latency there were sig- 
nificant differences between viewing one vs. three faces [F(i,i2) = 
20.23, p < 0.0025], and one vs. two faces [F(i, 12) = 14.70, p < 
0.0025], but not two vs. three faces [F(i t u) = 0.54, ns]. These 
differences are depicted in Figure 4D. 

In contrast, P250 and P400 latencies were not affected by 
viewing different face numbers [P250, F@, 24) = 0.93, ns; P400, 
F(2, 24) = 0.79, ns]. 

There were no significant main effects of hemisphere or signif- 
icant interaction effects for P100, N170, P250, or P400 latencies. 

ERP amplitude differences 

Somewhat unexpectedly, no effects of condition were observed 
for PI 00 amplitude, nor did it differ across hemispheres, or show 
an interaction effect. 

Similar to the previous experiment, N170 amplitude was again 
influenced by the number of faces viewed N170 [Fq, 24) = 10.80, 
p < 0.005], and this effect was again driven by viewing 3 faces 
(1 vs. 3, F = 33.16, p < 0.0001; 2 vs. 3, F = 4.94, p < 0.05], 
with no difference being observed between 1 and 2 faces (F = 
1.816, ns) (see Figure 4C). There were no significant effects of 
hemisphere, nor was there a significant interaction effect. 

Similar to N170, P250 amplitude was found to vary signif- 
icantly for number of viewed faces [F(2, 24) = 3.60, p < 0.05]. 
For P250, contrasts indicated that amplitudes were significantly 
larger for viewing three faces [1 vs. 3, F^ 12) = 5.55, p < 0.05; 
2 vs. 3, F(i_ 12) = 6.77, p < 0.05]. Amplitudes to viewing one vs. 
two faces were not significantly different [F(i_ 12) = 1.816, ns]. 
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FIGURE 4 | N170 characteristics as a function of stimulus set. (A) N170 
amplitude (in microvolts) as a function of face number (Cond) for the GBC 
stimulus set for right and left hemispheres. In both cases, N170 amplitude 
increases in a graded manner as the number of faces in the display 
increases. (B) N170 latency (in milliseconds) for GBC stimuli did not vary 
as a function of face number. (C) N170 amplitude increases in an 



approximate linear manner as a function of face number in both 
hemispheres for LBC stimuli. (D) N170 latency decreases significantly as 
the number of faces in the display increases for LBC stimuli. Legend: solid 
line plot reflect left hemisphere activity. Broken line plot depicts right 
hemisphere activity. Significant contrasts between conditions are displayed 
at the top of each plot. 



There was a significant effect of hemisphere for P250 amplitude 
[F(i, 12) = 7.93, P < 0.025], with P250 amplitude being larger in 
the right hemisphere overall. No significant interaction effect was 
observed. 

P400 amplitude was not observed to vary as a function of num- 
ber of faces, or by hemisphere of recording, nor was an interaction 
effects observed. 

DIFFERENCES IN ERP LATENCIES ACROSS EXPERIMENTS 

A clear shift in ERP peak latencies was seen when compar- 
ing the data across the two experiments (see broken vertical 
lines linking the respective sets of ERP waveforms in Figure 2). 
On average for Experiment 1 P100 occurred at around 125 ms 
when overall brightness and contrast were controlled (GBC), 
whereas in Experiment 2 an earlier P100 was elicited (peaking 
at around 104 ms post-stimulus) (LBC). Overall P100 laten- 
cies across Experiments 1 and 2 were compared using an 
unpaired f-test and were found to be significantly different 
across experiments [t(\ : 25) = 4.57, P < 0.0001]. Similarly, N170 
peaked at a mean latency of 180 ms for Experiment 1 and 



156 ms for Experiment 2 (t = 5.26, P < 0.0001). P250 peaked 
at mean latency of 241 ms and 219 ms for Experiments 1 and 2 
(t = 3.14, P < 0.005), respectively. This pattern of latency dif- 
ferences was not as evident in the more broadly distributed 
P400 (Figures 3A,B bottom row), which tended to be harder 
to identify in the group averaged data in Experiment 2. P400 
peak latencies of 387 ms and 409 ms were calculated using the 
ERP data of individual participants. These differences were 
not significant (f = 1.24, ns). Overall, there was a systematic 
difference in ERP peak latencies (P100, N170, and P250) of 
around 22 ms across the two Experiments, which was most 
likely driven by the greater overall brightness and contrast of 
Experiment 2. 

Using a similar comparison, mean ERP component ampli- 
tudes were also contrasted across experiments. While P100 
and P250 differences were not significant (PI 00 t = —0.02, ns; 
P250 t = -0.62, ns), N170 and P400 amplitudes did show 
significant differences across the two experiments (see also 
Figure 2) (N170 t = 2.95, P < 0.01; P400 t = 7.87, P< 
0.0001). 
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RESULTS SUMMARY 

Table 1 summarizes the significant main effects and interactions 
for all tested ERP components across the two experiments. The 
effects of stimulus attributes on the PI 00 and N170 manifested 
as latency differences in Experiment 2 when the number of faces 
was varied in a preserved local brightness and contrast envi- 
ronment, and the later component latencies (P250 and P400) 
appeared to be unaffected by the face number manipulation. 
When overall brightness and contrast of the stimulus display were 
controlled PI 00 and N170 latency effects disappeared, suggest- 
ing that these latency differences were caused by differences in 
low-level stimulus attributes. Interestingly, the later ERP compo- 
nents (P250 and P400) showed latency differences as a function 
of hemisphere — with significantly larger responses occurring over 
the right posterior temporal scalp. 

Strikingly, N170 amplitude was modulated by the number of 
faces in the display irrespective of the variation in global or local 
brightness and contrast (Table 1). Unlike N170, P100 showed a 
significant interaction effect in the GBC experiment, where the 
larger number of faces elicited larger PlOOs in the left hemisphere. 
Both P250 and P400 amplitudes remained unaffected by the face 
number manipulation. No effect for PI 00 or P400 amplitude was 
observed in the LBC stimulus experiment. P250 showed an inter- 
action effect, with the larger number of faces eliciting the largest 
amplitudes in the right hemisphere. 

There was a significant difference in ERP latencies for PI 00, 
N170, and P250 across the two experiments — with latencies being 
earlier for LBC (Experiment 2) relative to (GBC) Experiment 1. 

DISCUSSION 

In this study we performed different types of brightness and con- 
trast manipulations across our two stimulus sets. In the GBC 
experiment, the overall brightness and contrast of the image was 
equated. So as to equate the overall brightness and contrast of the 



Table 1 | Summary of statistical analysis of ERP data for both 
Experiments. 



Measure Experiment 1: GBC Experiment 2: LBC 





P100 




+ (Face) 




N170 




+ (Face) 




P250 


+ (Hemi) 






P400 


+ (Hemi) 






AMPLITUDE 


P100 


+ (Face x Hemi) 






N170 


+ (Face) 


+ (Face) 




P250 




+ (Hemi), 


+ (Face) 


P400 









Significant main effects of number of faces viewed (Face) and hemisphere 
(Hemi), and interactions (Face X Hemi) are identified for the four different ERP 
components are tabulated as a function of the preserved global brightness 
and contrast (GBC) and preserved local brightness and contrast (LBC) stimulus 
sets. Latency and amplitude data were tested for all ERP components. Legend: 
+, significant result; —, non-significant result. 



stimuli, the local brightness of the face stimuli had to be system- 
atically altered as a function of the increase in face number. In 
the LBC experiment, overall brightness and contrast of the image 
varied, whereas local brightness and contrast in the image was 
preserved. In addition to these brightness and contrast manipu- 
lations, other variables that were manipulated were stimulus size 
(considerably larger visual angles in GBC relative to LBC), as well 
as stimulus delivery method (GBC: projection on to a white wall 
from a gray background; LBC presentation on a computer mon- 
itor from a black background). Strikingly, despite these many 
differences in stimulus characteristics, and irrespective of vari- 
ation in overall or local brightness and contrast, stimulus size, 
and stimulus presentation from different inter-stimulus back- 
grounds, and stimulus delivery, N170 amplitude is modulated by 
the number of viewed faces — with three face displays eliciting 
the largest responses. The later ERP components showed more 
complex effects with respect to their amplitudes — when overall 
luminance and contrast were adjusted to be constant (GBC) no 
systematic amplitude differences were observed in P250 or P400 
amplitudes. In terms of latencies, the early components (P100, 
N170) showed a significant effect of face number when overall 
luminance and contrast were allowed to vary (LBC). Comparing 
the data from the two experiments, a systematic latency difference 
of around 22 ms was observed, with the ERP data from the LBC 
experiment where there was a brighter and higher contrast dis- 
play exhibited the earliest responses. Having said that, differences 
in stimulus size across the two experiments could also impact ERP 
latency and amplitude measures, and smaller stimuli should pro- 
duce smaller ERPs (see McCarthy et al, 1999). In our case, the 
smaller size for stimuli in the LBC relative to those in the GBC 
experiment, may well have undercut the latency difference seen 
between the two experiments: if the stimulus sets had have been 
the same size, then perhaps the LBC stimuli could have produced 
even greater differences in latency relative to the GBC stimuli 
across the two experiments. 

EFFECTS OF STIMULUS BRIGHTNESS, CONTRAST, AND SIZE 
ON NEURAL ACTIVITY 

It has long been known that neurophysiological responses to 
visual stimuli vary their amplitude and latency as a func- 
tion of stimulus contrast and brightness (Regan, 1972; Halliday 
et al, 1973; Chiappa, 1983). Diffuse light flashes demonstrated 
increased amplitudes and decreased latencies to early visual 
evoked response studies in human subjects (Wicke et al., 1964; 
Sokol and Riggs, 1971). Later studies using alternating black and 
white gratings or checkerboards elicited visual evoked responses 
with decreased latency and increased amplitude to greater bright- 
ness and contrast of the visual display (Campbell and Kulikowski, 
1972; Regan, 1972). Hence, visual neurophysiologists have always 
balanced brightness and contrast of visual stimuli, particularly 
in clinical studies (Chiappa, 1983). This becomes more challeng- 
ing when using complex stimuli that include faces and objects. 
It is possible to equate overall image brightness and contrast 
when presenting single static images such as faces and/or objects 
(Allison et al, 1994, 1999; Bentin et al, 1996). However, this 
problem becomes significant when dealing with animated visual 
stimuli or "real-life" activation tasks. In studies using apparent 
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motion stimuli, stimulus frames have been adjusted for these 
attributes (Carrick et al., 2007), however, this is much harder 
to accomplish when using stimuli such as movies (Hasson and 
Malach, 2006; Golland et al., 2007). 

With the exception of N 170 amplitude, the data from the two 
experiments indicate that changes in overall and local bright- 
ness and contrast not only influence, but can also confound, the 
response properties of visual evoked responses to higher-order 
stimuli such as faces. In the LBC data set (Experiment 2), P250 
amplitude varied with increasing face number, as a function of the 
overall brightness and contrast properties of the image, despite 
local brightness and contrast being preserved. P250 amplitude 
changes were abolished in the GBC data set, where local bright- 
ness and contrast of the faces was systematically manipulated to 
preserved overall image brightness and contrast (Table 1). The 
latencies of the later ERP components, P250 and P400, showed 
latency differences across hemispheres only in the experiment 
where the overall brightness and contrast were controlled, but 
where the local brightness and contrast (and perhaps discrim- 
inability) of the face stimuli was altered. These observations are 
important, as they contradict a long-held belief that only the 
earlier ERP components, or those that are associated explicitly 
with perception, e.g., P100, are susceptible to these low-level 
stimulus attribute manipulations. Indeed, the systematic latency 
difference of approximately 22 ms across the two experiments for 
all ERP components, early and late, indicates the importance of 
paying attention to these stimulus attributes. This suggests that 
care be taken when designing paradigms where visual stimula- 
tion is complex. Where stimulus brightness and contrast cannot 
be easily adjusted, perhaps using measures of brightness and con- 
trast as regressors or co-variates in statistical analyses should be 
considered. 

With respect to stimulus issues, our study also had a num- 
ber of important differences between the two experiments. In 
Experiment 1, stimuli were projected on a white wall with a video 
projector with a larger visual angle, whereas in Experiment 2 
stimuli were viewed on a computer monitor. It is important to 
note that despite large differences in stimulus size (much larger 
stimuli in GBC or Experiment 1 relative to LBC or Experiment 2), 
significantly shorted ERP latencies were observed in Experiment 2 
(LBC). In Experiment 1 inter-stimulus periods consisted of a gray 
screen upon which the faces embedded in an irregular back- 
ground were presented, whereas in Experiment 2 a black screen 
was present in inter-stimulus stimulus periods upon which the 
stimuli, consisting of the faces embedded in a white rectangle 
were projected. Differences in how the stimuli appear in their final 
state, with respect to brightness and contrast, as delivered by the 
video projector and also the computer monitor are difficult to 
quantify accurately. We chose to measure the overall brightness 
and contrast of all stimuli (Figure 1) relative to the images them- 
selves from calculations based on grayscale pixel values. There is 
always the potential for irregularities in stimulus intensity profiles 
to occur with video projection or in computer monitors. Having 
said that, in both experimental manipulations N170 amplitude 
was found to be sensitive to item number despite large differences 
in stimulus delivery and size of stimuli, underscoring the robust- 
ness of this experimental finding. Indeed, increasing stimulus size 



has been noted to increase the amplitude and reduce the latency 
of the N200 elicited to face stimuli (Allison et al, 1999). In our 
experiment, earlier and larger ERPs were elicited to the smaller 
face stimuli (Experiment 2), whose overall contrast and bright- 
ness varied more than that for Experiment 1 . We believe that our 
results reflect the strong effects of overall brightness and contrast 
on ERPs. 

One limitation of our study was that we did not systemati- 
cally study effects of size and stimulus number in our experiment. 
Instead we chose to use two very different stimulus sizes and 
ways of displaying stimuli to subjects so as to look for com- 
mon neurophysiological effects that might scale with numerosity. 
Interestingly, for stimuli that consist of arrays of dots it has been 
reported that ERPs are not affected by the numerosity judgment 
per se, but instead are more likely to be modulated by the visual 
stimulus size (Gebuis and Reynvoet, 2012, 2013). Unlike for the 
experiment with dots, within each of our experiments, we did 
demonstrate an effect of numerosity in ERP measures e.g., N170, 
where visual item size was constant within the experiment. We 
did also perform an explicit comparison between the data of our 
two experiments and showed clear differences in ERP latencies 
and amplitudes that we believe were driven by brightness and 
contrast — however, it raises the question as to whether these dif- 
ferences would have been even greater if we had have kept our 
stimulus display sizes the same across the two experiments and 
varied only brightness and contrast. This is an important line of 
future investigation for studying neural activity elicited to mul- 
tiple faces, given that on a daily basis we see other individuals at 
many different spatial scales, depending on what their respective 
distance from us is at any given time. 

One important, low-level, variable that must also be consid- 
ered is that of spatial frequency. Faces form a homogeneous class 
of objects with so-called middle range spatial frequencies e.g., 
1 1 cycles/image, and this property could be a driving factor for 
eliciting larger N170s to faces relative to objects, as objects typ- 
ically are much more diverse and have a wider spatial frequency 
content (Collin et al., 2012). Interestingly, N170 has found to be 
sensitive to manipulations of spatial frequency for images of faces 
and objects alike (Collin et al., 2012), however, it is thought that 
high-spatial frequencies in face stimuli e.g., those greater than 24 
cycles/image do not greatly influence the generation of the N170 
(Halit et al, 2006). In our study, the increase in face number 
was also associated with an increase in the amount of middle 
range spatial frequency information that was presented in the 
image. An additional set of experiments to investigate the effects 
of increasing spatial frequency content in images would be needed 
to ascertain to what extent the increased N170 to face number is 
influenced directly by this low-level stimulus variable. 

ERP/EEG ACTIVITY TO VIEWING MULTIPLE STIMULI FROM NON-FACE 
CATEGORIES 

Much focus in the literature has been centered on the N170 that is 
elicited to faces. Having said that, it has been clearly demonstrated 
that the N170 ERP is elicited to other stimulus categories such as 
objects, albeit being significantly smaller relative to that observed 
to faces (Bentin et al., 1996; Rossion et al., 2003; Guillaume et al., 
2009). Intracranial recordings of category-sensitive potentials 
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e.g., N200, thought to be a similar manifestation to the scalp N170 
(Rosburg et al., 2010), have clearly shown that category-sensitive 
ERPs can be elicited to face, face parts, letterstrings, hands, and 
objects, and N200 amplitude varies as a function of subdural elec- 
trode position on the occipitotemporal cortex (Allison et al., 1999; 
McCarthy et al, 1999; Puce et al., 1999). 

There is a growing literature on the neural correlates of 
numerosity, which has typically used homogeneous visual dis- 
plays of targets in the form of dots (Gebuis et al., 2010; Ester 
et al, 2012; Vuokko et al., 2013), usually for the purposes of 
studying counting and subitizing, or letters or numbers (Gebuis 
et al., 2010). In displays where targets are presented in a lat- 
eralized fashion and are intermixed with non-target distractors, 
the most predominant ERP component that is observed is a so- 
called parietal N2pc. N2pc has been found to vary monotonically 
with increasing target stimulus number for explicit judgments of 
numerosity (Pagano and Mazza, 2012; Mazza et al., 2013) or for 
judgments involving subitizing (Ester et al., 2012). As noted ear- 
lier, the behavior of N2pc and Nl (analogous to N170 in our 
study) have been dissociated in ERP studies, where Nl has been 
found to be modulated by increasing item number when targets 
are presented without distracters, whereas N2pc will exhibit mod- 
ulation as a function of numerosity in all types of displays (Mazza 
et al, 2013). An interesting pattern of results has also emerged as 
a function of small (e.g., 1-3) vs. large (e.g., 8-24) item num- 
ber in a passive viewing paradigm. The temporal-occipital Nl 
(analogous to N170 in our study) varied monotonically for small 
numbers and not for larger items (Hyde and Spelke, 2009). In this 
same study a later ERP — the P2 was found to vary as a function 
of the larger item number. Having said that, some investigators 
have argued that stimulus size, as determined by the spatial extent 
of the dot layout, may also be a critical variable when mak- 
ing numerosity judgments (Gebuis and Reynvoet, 2012, 2013). 
Differences of appearance of targets in foveal, parafoveal and 
extrafoveal regions of the visual field may also factor into these 
variations. 

An important question that emerges from the data presented 
in this study is whether the category-sensitive N170, as elicited to 
other important categories of very complex, but important, stim- 
uli to humans e.g., objects, hands, would also produce graded 
changes in N170 amplitude for constant brightness, contrast, 
and stimulus size. Comparing a number of stimulus categories, 
including scrambled images that preserve the spatial frequency 
content of the original image, in a series of experiments would be 
required to successfully resolve this issue. 

INCREASED AROUSAL AND BEING WATCHED BY OTHERS 

All of us can recall a situation where we might have felt uncom- 
fortable because we were being watched or were the focus of 
attention of a large group of people. Public speaking is a typi- 
cal example of where many people report being uncomfortable. 
Most healthy individuals will report feel some degree of anxi- 
ety or discomfort in this situation. What causes the discomfort? 
It is thought that there is an increase in arousal when being 
even gazed at even by a single face (Conty et al, 2010b), so that 
this might be likely to be magnified is the eyes of a group are 
upon an individual. Associated with this increase in arousal are 



autonomic nervous system changes such as increased heart and 
respiration rate, pupillary constriction, "butterflies" in the stom- 
ach, a dry mouth, trembling, or shaking (which may also manifest 
by changes in voice), which can also occur with intense emotions 
(Stephens et al, 2010). 

N170 amplitude increased systematically with increasing face 
number in both experiments. Hence, unrelated to overall or 
local luminance/contrast changes, an increasing number of faces 
elicited augmented N170s; however, it could be argued that 
changes in the spatial layout of the faces might also influence 
these ERP amplitude changes. The face-sensitive N 170 is also typ- 
ically larger to faces relative to other object categories (Bentin 
et al, 1996; Eimer and McCarthy, 1999; Taylor et al., 1999; Eimer, 
2000; Itier et al, 2006; Rossion and Caharel, 2011), albeit to a 
lesser extent than to faces (Rossion et al, 2000). It appears that 
N170 amplitude can be influenced by expertise and training with 
other object categories (Tanaka and Curran, 2001; Scott et al., 
2006). 

The underlying mechanisms for the N170 amplitude increase 
proportional to face number are yet to be elucidated. The data 
raise a number of interesting, although somewhat unrelated, 
questions: do more faces simply drive the system more? How does 
the position of the face grouping in the visual field modulate neu- 
ral activity? Is it that direct gaze, when experienced from more 
than one individual, creates a greater arousal effect that results in 
an augmented N170? Is it that more items in the display drive 
the system more — an effect that has nothing to do with faces? 
How do N170s elicited to multiple faces differ to those elicited to 
the same number of non-face objects in the display? Experiments 
where these variables are disentangled need to be performed to 
help elucidate the mechanisms underlying the involuntary and 
seemingly automatic neurophysiological response that is elicited 
to the human face. 

CONCLUSION 

In sum, N 170 is elicited to a face, and the more faces are present, 
the larger its amplitude. Importantly, the presence of a complex 
background or large changes in image brightness, contrast or size 
do not appear to affect this basic finding. However, given that 
N170 also shows category-sensitivity to other stimulus categories, 
a set of experiments further investigating stimulus categories and 
how these might interact with variables such as spatial frequency 
would be required to completely resolve this issue. 
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